Adaptive enclosure for a mobile computing device

ABSTRACT

A device includes an enclosure and logic. The enclosure includes a plurality of capacitive touch sensor arrays disposed at least on two of a top side, a bottom side, a left side, a right side, a front side, and a back side of the device. The enclosure also includes a first display on the front side of the device. The logic receives touch interaction information from the plurality of capacitive touch sensor arrays and initiates an action based at least in part on the touch interaction information.

CROSS-REFERENCE TO RELATED APPLICATIONS

This Application is a continuation (and claims the benefit of priorityunder 35 U.S.C. § 120) of U.S. Ser. No. 17/092,783, filed Nov. 9, 2020,now U.S. Pat. No. 11,106,246, issued Aug. 31, 2021, entitled “ADAPTIVEENCLOSURE FOR A MOBILE COMPUTING DEVICE,” which is a continuation ofU.S. Ser. No. 15/038,657, files May 23, 2016, now U.S. Pat. No.10,831,318, issued Nov. 10, 2020, entitled “ADAPTIVE ENCLOSURE FOR AMOBILE COMPUTING DEVICE,” which is a national stage application under 35U.S.C. § 371 of PCT International Application Serial No.PCT/CN2013/090282, filed on Dec. 24, 2013, entitled “ADAPTIVE ENCLOSUREFOR A MOBILE COMPUTING DEVICE,” which are hereby incorporated byreference in their entirety.

TECHNICAL FIELD

Embodiments that are disclosed relate to mobile computing deviceenclosures.

BACKGROUND

Mobile devices, such as smartphones, tablets, portable video gamesystems, and phablets (a portmanteau term for a smartphone as large as asmall-sized tablet, as well as for a small-sized tablet with telephony),have a basic touchscreen capability. This touchscreen permits a user tointeract with objects displayed on the touchscreen by touching areasthereon. It is an intuitive interface to play games, scroll throughpages of a book or pictures of a slideshow, browse webpages on theInternet, zoom in/out of pictures, and input keyboard strokes.

Existing mobile devices have only one touch screen and fixed location(e.g., hardware) buttons along the sides of the devices. Accordingly, auser needs to locate where the buttons are along the sides of the deviceand hold the device in such a way that the user's fingers can access thefixed location buttons (e.g., power, volume, etc.). The buttons'locations and the device size can be uncomfortable for some users due tothe users' hand size and hold pattern.

Further, for people with small hands, these devices are sometimes hardto manipulate with just one hand.

When a user holds the device in one hand and uses his or her other handto press a button on one side of the device, the user might counter thismotion by tightly holding his or her fingers on the other side of thedevice. This tight holding can cause an unintended button pressing andundesired functional changes to the device.

In addition, in single-handed operations, a user might need to switchhand-hold patterns between viewing content on the front display andtouch interactions with the device. When the user views the content, theuser's thumb might lie along the side of the device to support a firmgrip of the device. To switch to a single-handed touch interaction, thehand grip sometimes changes so that the thumb is freed up to touch thefront display. This grip switching is not comfortable and risks droppingthe device. To avoid this risk, many users engage the other hand fortwo-handed touch interaction operations, which may not be feasible undercertain circumstances.

Additionally, many mobile devices do not provide multi-task controls.Only one application (app) may be in use at any given time, even if asecond app would merely display a limited amount of information. Forexample, the first app would have to be paused or stopped to check thecurrent temperature, and then the first app would have to be resumed orrestarted.

In other instances, when a user is performing an activity (e.g., readingemail or browsing the Internet) and an incoming phone call is received,some devices stop the current activity and bring up buttons or sliderson the touchscreen for the user to answer or reject the call.

In addition, current touchscreens limit user interaction withthree-dimensional (3D) objects on the touchscreen. As an example, a usercan only pat a 3D ball from the touchscreen. The user thus has to relyon unnatural, indirect gestures to access the non-touchable dimensionsof 3D objects.

Further, as a user's finger interacts with the screen, that finger canhinder the user from seeing what he or she is actually touching. Forexample, while playing one popular game, the user has to swipe thescreen to trigger a movement of a game character, but the swiping actionblocks the game character from the view of the user. A similar issue isnoticed when zooming in on an object, scrolling, or swiping acrosspictures, videos, etc.

Similarly, it can be difficult for a user to touch and move to a pointprecisely on the touchscreen, because the user's target point is oftenshaded by the user's finger. Even if there is a cursor provided by anapplication, the cursor might be smaller than the user's fingertip.

Existing solutions do not have robust intelligence for detecting userhand-hold context information. For example, existing solutions usemotion sensors to detect a device orientation and rotate display contentaccordingly. These motion sensors can cause an unintended and erraticscreen rotation when the device is moved or tilted.

Much of the time, a user merely desires a limited amount of informationthat can be presented with a text-based display or with minimalgraphics. As such, it is not always required to fire up the frontdisplay. As the display of a mobile device is a significant powerconsumer, reducing this power consumption would greatly enhance thebattery life.

The bezels of mobile devices are becoming thinner and thinner nowadays.Therefore, sometimes a touch event on the edges of the front screen isactually a grip to be detected and suppressed.

Conventional edge detection and grip suppression for touch panels areall about the location, dimension, shape and persistence of a touch onone single flat surface (not in a 3D space). Thus, these technologiesmake mistakes (e.g., a false touch event, a false suppression, aperformance deduction, etc.).

Further, when users grip the mobile device, some touch operations orgestures are performed on a side of the mobile device.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A, 1B, and 1C illustrate a mobile device with a sensor array onthe top, bottom, left, and right sides.

FIG. 2 illustrates a high-level architecture of the adaptive enclosurein many embodiments.

FIG. 3 illustrates an embodiment of the detailed adaptive enclosurelogic architecture.

FIG. 4 illustrates an embodiment of an implementation stack utilized ina system.

FIG. 5 illustrates multiple examples of where controls for differentfunctions can be located.

FIG. 6 illustrates an embodiment of how a given user can hold theadaptive enclosure device.

FIG. 7 illustrates another embodiment of how a given user can hold theadaptive enclosure device.

FIG. 8A and FIG. 8B show embodiments of alternative locations wherebuttons can be displayed based on hand grip location.

FIG. 9 shows a left hand gripping an adaptive enclosure device frombehind, where the fingers project onto the side sensors of the device.

FIG. 10 shows how a finger projection area can be split into two areas.

FIGS. 11A-11D illustrate another embodiment of an applicationinteraction with a user.

FIG. 12 shows an example of a horizontal hard button and soft buttonlayout implemented in one embodiment when the adaptive enclosure is heldwith both hands.

FIG. 13 shows an example of a vertical- and right-oriented soft buttonand emulated hard button layout implemented in one embodiment when theadaptive enclosure is held with a right hand.

FIG. 14 shows an implementation of a button ring, including soft buttonsand emulated hard buttons, in accordance with one embodiment.

FIG. 15 illustrates an embodiment of a determinative algorithm for achange in contact point pressure on the adaptive enclosure.

FIGS. 16A, 16B, and 16C describe an embodiment of the user holding thedevice and the thumb contacts.

FIGS. 16D and 16E describe an embodiment of the adaptive enclosure logicallowing for the display screen to be covered by certain fingertipcontact points.

FIGS. 17A and 17B describe an embodiment of interaction with a 3D objectusing the adaptive enclosure device.

FIGS. 18A-18D illustrate a backside pointer implementation for theadaptive enclosure device to allow for a precise back side pointercontact location.

FIG. 19 is a flow diagram of an embodiment of a process to provide acustom user interface on the adaptive enclosure device.

FIG. 20 is a flow diagram of an embodiment of a process to identify theuser of the adaptive enclosure device through the use of grip detectionlogic.

FIG. 21 illustrates an embodiment of a computing device thatincorporates the adaptive enclosure.

FIG. 22 shows an algorithm for a grip suppression interrupt routine fora side touch panel, according to one embodiment.

FIG. 23 shows an algorithm for a grip suppression interrupt routine fora front touch panel, according to one embodiment.

FIG. 24 shows an algorithm for determining how positions on a backsensor are mapped to a requested number of inputs.

DETAILED DESCRIPTION

Some embodiments described include a back and side capacitive touchsensor array for a mobile device. This inclusion, in addition to a frontcapacitive touch sensor array, allows for a fully adaptive enclosure toprovide additional functionality for a better user experience with themobile device. Some current solutions require the user to adapt to themobile device; the adaptive nature of the described enclosure allows forthe mobile device to more specifically adapt to the user.

FIGS. 1A, 1B, and 1C illustrate a mobile device with a sensor array 100on the top, bottom, left, and right sides. In some embodiments, thefront side of the mobile device includes a speaker and a microphone,generally at opposing ends of the front side. The front side can alsoinclude a display (such as a touchscreen including the sensor array) andone or more hardware buttons.

In some implementations, the back side of the mobile device includes acamera. This inclusion of the camera is no way limited to the back sideof the device: recently, cameras have been included in the front of thedevice, as well. In embodiments in which the front side camera differsfrom the back side camera, the front side camera is sometimes bettersuited to closer subjects, whereas the back side camera is better suitedto more distant subjects. It is also possible the back side camera is ofa higher quality, such as by offering a higher resolution image or agreater zoom ability.

The back side of the mobile device can also include a hardware button.Although the back side can include a display, this inclusion is nottypically the case.

Hardware features of the top and bottom sides and the right and leftsides generally depend on a manufacturer's preference. In oneimplementation, a power button is located on the right side or the topside of the device. A headphone jack can be included on the bottom side.A mini or micro USB connector is often included on the right side, theleft side, or the bottom side of the device, though such a connector canalso be implemented on the top side. Of course, the power button, theheadphone jack, and the USB connector can be included on any side or canbe absent.

Typically, the display (or displays) are rectangular but are, of course,not limited to that shape. Currently, smartphones commonly include arectangular display in which the nominal vertical direction is in thedirection of the length of the display. Thus, the top side and thebottom side are typically viewed as being at opposing ends of the lengthof the screen. In contrast, the right side and the left side of thedevice are typically viewed as being at opposing ends of the width ofthe display.

Currently, portable video game systems include a rectangular display inwhich the nominal vertical direction of the screen is in the directionof the width of the display. Thus, the top side and the bottom side aretypically viewed as being at opposing ends of the width of the screen.The right side and the left side are typically viewed as being atopposing ends of the length of the screen.

The above descriptions are not limiting. For example, some smartphonescan play video games, and some portable video game systems can interactwith cellular telephone networks. Similarly, such devices can rotate animage, so that the nominal vertical direction of the screen does notalways correspond to a vertical direction of a displayed image.

The orientations of the top and bottom sides and the right and leftsides are somewhat based on a default image position on the screen. Somemobile devices include sensors (e.g., tilt sensors or accelerometers)that determine a change in orientation of the device and modify theimage position based thereon. Other mobile devices include a hardwarekeyboard that extends from a side of the device, the extension of whichcan result in a modified image position. Thus, a person skilled in therelevant art understands that, although the sides can be somewhatsubjective, the sides are understood in any particular implementation.

In some embodiments, the side sensor array is coupled to a sensor arrayon the back side of the device and/or the front side of the device,though such coupling is not required. In many embodiments, each of thesix sides of the device has a separate sensor array. In otherembodiments, two or more of the sides have a single sensor array thatwraps around the device or is coupled in other manners. For example,there can be a separate sensor array for the front, for the back, andone for all four sides. In another example, the four sides and back havea single array, separate from the front array.

Additionally, the sensor pitch on the side array(s) can be the same asthe sensor pitch on the back or the front, though the same is notrequired.

FIG. 2 illustrates a high-level architecture of the adaptive enclosurein many embodiments. The front touch sensors 200 feed sensor input toboth front touch gesture logic 202 as well as adaptive enclosurealgorithm logic 204. The back and side touch sensors 206 feed sensorinput to the adaptive enclosure algorithm logic 204. The adaptiveenclosure algorithm logic 204 includes logic that detects hand grips,hand jitter filtering logic, and touch gesture recognition logic. Theseelements provide information to self-learning logic 210 as well as tothe user interface (UI) and one or more operating systems and/orapplications 208 running on the mobile device.

To increase the effectiveness of distinguishing intended gestures fromunintended hand or finger movements, the self-learning logic 210 cancontinuously gather data to refine the adaptive enclosure's knowledgebase on a person holding the device and in what orientation. Theself-learning logic 210 can receive data from back and side touchsensors 206, and front touch sensors 200. This data can be interpretedas adaptive enclosure interactive gestures. The adaptive enclosure logic204 interprets this ‘touch interaction data’ (i.e., the data that is aresult of a touch interaction between a user and one or more of thetouch sensor arrays) and sends it to the UI and applications 208. Thealgorithm logic 204 and UI and applications 208 receive this informationand can decide if the information comprises one or more valid gestures.If the algorithm logic 204 or UI and applications 208 interpret the dataas not valid, a message is sent to the self-learning logic 210. Theself-learning logic 210 keeps track of the validity of the gestures.Once a certain threshold is reached, the self-learning logic 210 willinform the adaptive enclosure algorithm logic 204 to invalidatespecified gestures.

The self-learning logic 210 can keep track of data on a user-by-userbasis to adapt to users individually. The self-learning logic 210 cancreate a usage model for each user, which is a learning model of how agiven user holds and interacts with the device. The more precise is thetracking of the usage model per user, the more easily the device canidentify a user holding the device. Additionally, the self-learninglogic 210 can also have different models per user for how to trackpositive contacts versus inadvertent contacts.

The self-learning logic 210 can keep track of grip patterns, grippressure, gesture commonalities, etc., and provide information asfeedback to the adaptive enclosure algorithm logic to create a trainingability. This feedback allows the adaptive enclosure algorithm logic toincrease accuracy of gesture recognition and user recognition over time.

Due to the nature of the adaptive enclosure, an object being displayedon the device can be thought of as being inside of the enclosure andable to be manipulated from all sides of the device/object. For example,a 3D object, such as a cube, can be displayed and can be manipulatedfrom all sides of the cube based on user interaction with the six sidesof the device (i.e., front, back, top, bottom, left, and right). For 3Dgestures used to manipulate the user interface and interact with objectsand information within the device, touch sensor data from front touchsensors 200 and back and side touch sensors 206 are sent to the adaptiveenclosure algorithm logic 204. This touch sensor data allows acombination of all around touch data to create 3D gestures and 3Dmanipulations. More detailed descriptions of 3D gestures andmanipulations will be discussed below.

FIG. 3 illustrates an embodiment of the detailed adaptive enclosurelogic architecture. This logic architecture can be implemented insoftware, firmware, or hardware (or a combination of two or more formsof logic). In FIG. 3 , the sensor data are read from the back and sidecapacitive touch sensors 206, as well as from the front capacitive touchsensors 200. This data can be sent to many different specific logicunits that detect and utilize different touches and manipulations of theadaptive enclosure. These logic units include a grip detection logicunit 300, a hand jitter filter logic unit 302, a back touch gesturelogic unit 304, a side touch gestures logic unit 306, and a 3D touchgestures logic unit 308, among others.

The grip detection logic unit 300 can make determinations based on how auser is holding the adaptive enclosure. The grip detection logic unit300 can determine whether the user simply is holding the enclosure,manipulating the UI displayed on the enclosure, or a combination ofboth. Additionally, the grip detection logic unit 300 identifies thegrip of a specific user. For example, a parent might be holding theadaptive enclosure and hand the enclosure over to a child. The gripdetection logic unit 300 can determine the grip change and notify the UIand applications 208. The grip detection logic unit 300 also canascertain the hand orientation of the user (i.e., left hand grip versusright hand grip). The grip detection logic unit 300 is further describedbelow.

The hand jitter filter logic unit 302 can determine whether the movementof each contact point between a portion of a hand/finger and theadaptive enclosure is due to a determined manipulation by the user orsimply a byproduct of a hand in contact with the device throughinadvertent touching or general gripping. This determination can beaccomplished using a temporal filter and a spatial filter, integratedinto the hand jitter filter logic unit 302. The temporal filterdetermines the length of time of a given touch event. The spatial filterdetermines the physical distance between multiple touch events as wellas the significance of the contact of a given touch event (e.g., did afingertip barely brush a surface or come into significant contact with asurface?). More details of the hand jitter filter logic unit 302 aredescribed below. This significance determination can be based on themagnitude of the pressure of the contact as well as the distance,velocity, or acceleration of the contact.

Some embodiments address an issue in conventional technologies in whicha gesture with more than one finger requires a mobile device user to useboth hands or to place the device on a surface to only use single-handedcontrol.

The adaptive enclosure allows gesture control to be a multi-touch level,hence enabling single-hand usage of the enclosure. By utilizing a reartouch sensor, the second and/or third touch can be made while allowingthe thumb to be the primary control at the front touch sensor.

Multi-touch gestures can be achieved by combining two or more fingers,such as index and/or middle finger(s) at the rear, and a thumb at thefront touch sensor.

As users become more mobile and multi-task, single hand control of themobile device can provide more flexibility. For example, a user might beholding shopping bags with one hand, while the other hand holds a mobiledevice. Further, the user might be reading a document and wish to zoomfor a clearer view. The user can opt to use both hands and place theshopping bags down, in which case she later needs to pick them up again,or she can go through several menu options to zoom the page.

Currently, most systems allow a double tap for zooming, but the zoomlevel may not be sufficient, as some users require more in-depthzooming.

The back touch gestures logic unit 304 interprets hand and fingergestures that occur on the back of the device from the data captured bythe sensors. Table 1 illustrates a partial list of gestures that occuron the back of the device and are supported in one embodiment.

TABLE 1 Back gestures. Back Gestures Details Usage Example Swipe Swipeone finger or multiple Scroll to the left on a Left fingers from rightto left web browser, ebook, on the back of the device slideshow, or filemanager Swipe Swipe one finger or multiple Scroll to the right on aRight fingers from left to right on web browser, ebook, the back of thedevice slideshow, or file manager Swipe Swipe one finger or multipleScroll up on a web Up fingers from bottom to top browser or ebook; or onthe back of the device zoom out on a camera or image; or escape fromcurrent application Swipe Swipe one finger or multiple Scroll down on aweb Down fingers from top to bottom browser or ebook; or on the back ofthe device zoom in on a camera or image; or minimize application TapLeft Tap one finger or multiple fingers Use sword in a game Top on theleft top region on the back of the device Tap Left Tap one finger ormultiple fingers Throw bomb in a game Bottom on the left bottom regionon the back of the device Tap Tap one finger or multiple fingers Firegun in a game Right on the right top region on the Top back of thedevice Tap Tap one finger or multiple fingers Fire missile in a gameRight on the right bottom region on the Bottom back of the device TapTap anywhere on the back of Take a picture in a the device cameraapplication; or zoom in on 3D object Double Double tap anywhere on theback Take a burst of pictures Tap of the device in a camera applicationPinch Two fingers touch down on the Zoom in on a web back of the deviceand move browser, ebook, or closer to each other photo viewer ReverseTwo fingers touch down on the Zoom out on a web Pinch back of the deviceand move browser, ebook, or farther apart from each other photo viewerCircle One finger draws a clockwise Rotate the display circle on theback of the device content clockwise Reverse One finger draws a counterRotate the display Circle clockwise circle on the back of contentcounter the device clockwise

As shown above, the adaptive enclosure can be developed into a gamingcontroller that has several specific buttons to improve a gamingexperience for the user. Human fingers have muscle memory: thus, a userthat practices with such a touch controller can easily adapt the areasto their needs in a short time, even though the buttons are notdedicated hardware buttons. Since a typical sensor is capable of sensingten fingers simultaneously, handling the response from the adaptiveenclosure is possible without adding any significant extra complexityinto the system or software. One embodiment of this handling is detailedbelow.

Other actions can be implemented with a combination of gestures on boththe back and the front.

TABLE 1 Combination gestures. Action/Gesture Rear Touch Front TouchZoom-in Index Finger (hold) Thumb (Swipe) - Place the thumb at the topand move the thumb away from the index finger position (downward) tozoom-in Zoom-out Index Finger (hold) Thumb (Swipe) - Place the thumb atthe bottom and move the thumb towards the index finger position (upward)to zoom-out Rotate Left - Index Finger (hold) Thumb (Swipe) - Place thePhoto will be thumb on the middle left and rotated 90 move the thumb ina circular degrees to motion anti-clockwise to rotate the left photosRotate Right - Index Finger (hold) Thumb (Swipe) - Place the Photo willbe thumb on the middle left and rotated 90 move the thumb in a circulardegrees to motion clockwise to rotate the right photos Minimize - Indexand Middle N/A Current running Finger (Swipe) - application will Withboth fingers be minimized positioned at the top, and the main move bothfingers menu will be downwards to shown minimize application that isrunning Maximize - Index and Middle N/A Last viewed Finger (Swipe) -application With both fingers will be positioned in the maximizedmiddle, move both fingers upwards to maximize the last viewedapplication Back - Goes Index Finger (hold) Thumb (Swipe) - Place theback to thumb on the middle right and previous move the thumb left to goback page while browsing Forward - Goes Index Finger (hold) Thumb(Swipe) - Place the forward to thumb on the middle left and latest pagemove the thumb right to move while browsing forward

The side touch gestures logic unit 306 interprets hand and fingergestures that occur on the sides of the device (top, bottom, left, andright) from the data captured by the sensors. Table 2 illustrates apartial list of gestures that occur on the side(s) and are supported inone embodiment.

TABLE 3 Side gestures. Side Gestures Details Usage Example Slide UpSlide one finger upward along one side Turn up audio (top, bottom, left,right) of the device volume Slide Slide one finger downward along oneTurn down audio Down side (top, bottom, left, right) of the volumedevice Tap Tap one finger on one side (top, Put device to bottom, left,right) of the device sleep Double Double tap one finger on one sideAwaken device Tap (top, bottom, left, right) of the device Hand Handgrip opposing sides of the device Increase/decrease Grip and graduallyincrease or decrease slide show speed; Squeeze pressure of the grip ortake a picture Top Hand hold the device with one finger Press shutterButton on the current top side of the device button in Press and tap onefinger and contact at least camera one side (to steady camera)application

Combining the back, side, and front touch sensor logic, a user candirectly access three dimensions of any 3D object presented on thecomputing device in a natural and intuitive way. Additionally, theobject may be displayed in three dimensional space on any or alldisplays on the different sides of the device, giving the impression tothe user as if the object was inside the adaptive enclosure deviceitself.

In one example, the user performs gestures on one or multiple sides ofthe enclosure. The enclosure displays on different sides of the devicedifferent views of the 3D object. Based on the gestures, the enclosuremanipulates the 3D object. This manipulation gives the impression to theuser that she is interacting in three-dimensional space with athree-dimensional object.

Table 3 illustrates a partial list of 3D gestures and manipulations thatcan be used for accessing 3D objects in an intuitive way according toone embodiment.

TABLE 4 3D gestures. 3D Gestures Details Usage Example 3D One finger onthe back side of a 3D Rotate a 3D object Rotate object (on back side ofthe adaptive in 3D space enclosure), one finger on front side of 3Dobject (on front side of the enclosure), the two fingers slide in theopposite directions or one finger is still and the other finger slides2D Two fingers on one side pinch (front Zoom in or out Zoom or back) inor out 3D At least one finger on one side of Stretch or shrink Stretchenclosure to remain still and two surface of a 3D fingers on the otherside of object nearest the enclosure to pinch in or out two fingers 3DAt least one finger on front enclosure Press/deform a Press surface andat least one finger on 3D object back enclosure surface of device and ontwo opposite press towards each other surfaces

Thus, in response to a determination by a processor of the mobile devicethat any of the above user interactions are performed on the mobiledevice, the corresponding operation in the chart can be performed. Suchrelationships between the described user interactions and thecorresponding operations are intuitive. Of course, the determination canalso be performed by a processor outside of the mobile device, as well.

In addition, other 3D gestures can be input, as well. For example, a 3Dobject can be rolled (i.e., rotated and translated) by sliding a fingeralong the back. This interaction provides a user with a sense that theitems in an application have a greater dimension of depth.

In some embodiments, the adaptive enclosure logic 204 encapsulates allsix sides and, thus in an alternative version of FIG. 3 , the fronttouch gesture logic 202 is also included within the adaptive enclosurealgorithm logic 204.

To free a user to perform tasks without any hindrance to the view of thedisplay, a sensor can be added on the back of the mobile device eitherdirectly on the device or on a protective skin. One potential advantageof using a sensor at the back is that many use cases, such as playinggames, browsing, scrolling, zooming etc., can be performed with just theone hand currently holding the mobile device. The other hand is freedfrom actually touching the front touchscreen or sensor to enter usercommands to the device.

This back sensor need not encompass the entire back side of the device.For example, in embodiments in which the device includes a camera on theback side of the device, the touch pad need not extend to the camera.

In implementations in which the sensor is embedded in a protective skin,a connector used to send the touch information to the mobile device canprovide a direct wired connection (e.g., USB) or a wireless connectionusing a technology such as Bluetooth, Wi-fi, Near Field Communications(NFC), etc.

For an application to progress, all it takes is a mechanism for userswipe information to be fed into the software stack; the program willbehave exactly the same way but with a better user experience as theuser can see the entire screen all the time. For scrolling throughpictures/files, a user can perform these actions while one hand isholding the mobile device, and the other hand swipes across the backtouch surface either vertically or horizontally.

Thus, a user can handle many tasks without the use of the devicerequiring two hands or the user being required to touch the display onthe front all the time. The user can simply interact with the adaptiveenclosure to achieve a better user experience from the device. Someimplementations are mode-agnostic and will work well for both portraitand landscape modes of the device.

The adaptive enclosure can thus help enhance the user experience,depending on the application. Typical scenarios of use includetapping/sliding (e.g., for playing games that do not require individualinputs).

FIG. 4 illustrates an embodiment of an implementation stack utilized ina system. The sensor electrodes 400 within a capacitive array changecapacitance based on a user touching or nearly touching the screen. Thecapacitive sensors 402 capture the capacitive change into data. Thesensor drivers 404 read the captured data and send the data to upperlayer logic, such as gesture logic 406. In turn, gesture logic 406interprets the received data and detects touch gestures from the data,which are then sent to the API 408. The API 408 provides a communicationinterface from the gesture logic 406 to upper layer applications 410.Finally, the applications 410 receive and respond to the received touchgestures. By implementing this stack and having an enclosure that hascapacitive touch sensor arrays on up to all six sides, an adaptivedevice can be realized.

The adaptive enclosure device is capable of any number of user-friendlygesture implementations. Specifically, the adaptive enclosure can enablethe device to adapt to the user. In many embodiments, the adaptation tothe user is in the form of the provision of UI elements, such as virtualbuttons, sliders, etc., on the back and the sides of the device and in aposition accommodating the way in which the user holds onto the device.In some embodiments, the virtual buttons can be dragged from oneposition to another. In embodiments in which there are displays on aside or the back (in addition to the front side), the buttons can bedragged and dropped on the respective side or to any other side. Inother embodiments, the representations (e.g., images) of the buttons canbe dragged and dropped on the front display. During such a drag anddrop, the representations can be displayed on the front displaytranslucently or grayed-out, for example. Thus, a user can hold thedevice in the most comfortable way for that individual, and the devicewill adapt to how the user holds the device. For example, the user canroll/slide his or her fingers along the side of the device to control amedia player volume, or tap his or her fingers along the side or back ofthe device to fire a different weapon in a video game or capture apicture using a built-in camera.

The adaptive enclosure additionally provides several single andmulti-handed usage models and context switches. For example, in asingle-handed usage switch, without changing a touch grip pattern, usageswitching can occur between a viewing mode and a touch interaction mode.

FIG. 5 illustrates an example of placement of controls for differentfunctions in one embodiment. As already discussed, the adaptiveenclosure 500 can have touch sensor arrays on up to all six sides. Inthe embodiment of FIG. 5 , the adaptive enclosure also has displays onall of those sides (e.g., capacitive touch screen displays as describedlater). In an alternative example, less than all six sides havedisplays, although all six sides have capacitive touch sensor arrays.Volume controls 502A-C and play (forward/reverse) controls 504A-C can bepresent in any number of locations. Three separate locations are shownin FIG. 5 for each control: 502A and 504A being on the front of thedevice, 502B and 504B being on the top of the device, 502C and 504Cbeing on a side of the device.

A display can be located around the edges of the mobile device. Such adevice can have up to four available edges, and displays can beselectively placed on one or more of the edges. In one embodiment, thesedisplays are LCD displays in the form of a strip. The displays can showtext and simple graphics. For example, the edge display can show stockquotes or a stock ticker, a weather report including currenttemperature, chance of rain, humidity, sunrise time, sunset time, windspeed, etc., a Tweet, an email, or the current time.

The edge display can also display a customized color or image. Thisdisplay can lead to personalization of the mobile device. In otherembodiments, such display can change the color based on occasion or evenanimate when a call comes through.

The edge display can also be touch-enabled and show UI components suchas buttons, sliders, etc., such as volume controls 502B, 502C and playcontrols 504B, 504C. In one such example, the edge display can be usedto move the display to view more details.

In another example, when the device is turned off, if a call comesthrough, an edge display alone can show the telephone number from whichthe call is received, as well as soft buttons for accepting or rejectingthe call. The main display can remain off if in a same state as beforethe call was received.

To enable a touch feature, electric field sensing (EF) technology can beutilized. The EF technique utilizes the change in an electric fieldintroduced by the presence of an object between receiver and transmitterelectrodes. An AC signal applied to a transmitter electrode induces anAC current in the receiving electrode. This current can be amplified andprocessed for usage. When a third object comes near, it alters thecurrent reaching the receiver. If the object is grounded, it will reducethe induced current; if it is floating, it will increase the current.

Thus, the display itself can be simple and thin as the display will notrequire the touch feature to be built into the display itself.

Another usage model is for the edge display to be added to the maindisplay. The issue with just one main screen is that, if an operationrequires the entire screen, and a simple task is to be performed, thecurrently running app has to be removed from the screen to perform thesimple task and then the original app has to be restarted. For example,suppose the user is watching a movie and needs to quickly check weatheror a current temperature. Instead of stopping the movie, checking thetemperature and then restarting the movie, the edge display can quicklybe checked for the temperature without leaving the movie playback.

The side edge display can display and control a volume level while afront touchscreen displays a video without the volume controlsoverlaying the video. This side edge display helps make the controlseamless and prevents clutter on the main display. For example, the sideedge display can display a volume slider along an edge of the device,such as 502B, 502C.

Media control buttons such as play/pause, seek, fast forward, back,etc., can be implemented on the edge display, freeing up the maindisplay. This implementation can prevent a finger from blocking thefront display while manipulating these controls.

Although FIG. 5 shows 502B and 502C occupying a portion of the sideedges, the edge display can cover the entire side edges.

Thus, some implementations can be used to build mobile devices that savepower, are highly customizable, and add features to the main display.

Further, the edge display can be used for enhanced security. Forexample, for payments, a unique code can be displayed on the edgedisplay which can be inserted into a slot to identify the device andhelp secure payments.

In some embodiments, the display on the front of the devicetranslucently shows UI controls that are on the back of the device.Thus, a user can interact with a backside control by touching a fingerto the back side of the device, yet an image of the control, for visualacuity, is displayed on the front side of the device. Specificimplementation details of such a translucent control are discussedbelow.

The locations at which these types of controls are located in FIG. 5 arepurely examples and are based on how a user is holding the adaptiveenclosure device at a given time or are based on the identification of aspecific user holding the device. The adaptive enclosure can customizethe location of the user interface controls for each user. Theselocations can be device-suggested customized locations from a histogramof how a given user holds the device or user-specified locations from acustomization of a given application run on the system.

FIG. 6 illustrates an example of a user holding the adaptive enclosuredevice 600 with a right hand. Contact sensor data on the front of thedevice with spacing and patterns for fingers shown in pattern 602 or asimilar pattern can indicate to grip detection logic 300 (in FIG. 3 )that the user is holding the device for carrying purposes and not forinteraction purposes. These types of patterns can also determine thehandedness of the user. Although the contact sensor data is only shownaffecting the front of the device, because the adaptive enclosure hassensor arrays on all six sides in many embodiments, the top, bottom,left, right, and back sides also can be used for grip pattern detection.

FIG. 7 illustrates another example, in which a user holds the adaptiveenclosure device 700. FIG. 7 demonstrates a left hand grip with anopposite handed holding pattern 702 to that illustrated in FIG. 6 .

FIG. 8A and FIG. 8B show embodiments of alternative locations wherebuttons can be displayed based on a hand grip location. In FIG. 8A, thevolume slider button 802A is placed near the thumb grip location upon aleft hand grip of the adaptive enclosure device 800, whereas theplay/pause button 804A is placed near the index finger grip locationupon the left hand grip. Alternatively, in FIG. 8B, the buttons arereversed. Namely, the play/pause button 804B is placed near the thumbgrip location upon the left hand grip of the adaptive enclosure device800, whereas the volume slider button 802B is placed near the indexfinger grip location upon the left hand grip.

Grip suppression will now be explained in the context of an embodimentin which touch sensors on three continuous surfaces are perpendicularlyjoined together (the front, the left and the right). By detecting datafrom these three surfaces (e.g., in 3D space), the grip can be betterdetected. Of course, the device can include three standalone touchsensors or one single flexible touch sensor covering all three surfaces.

By detecting a finger touch in 3D space (e.g., the front, the left andthe right side of the device), the grip suppression can be done moreaccurately and more easily.

For the current mobile devices, the HCl (Human-Computer Interaction) islimited to the touch screen in the front, while there are manypossibilities for better HCl in 3D space (the front, the left, and theright side).

As one embodiment, the software could be based on three separate touchsensors. As another embodiment, it could be based on one unitary andcontinuous flexible touch sensor that wraps around the adaptiveenclosure. The touch sensors on the left and right side can be asprecise (e.g., in the case of one single flexible touch panel), or theside sensors can be less precise to save on component expenses.

It is not relevant whether the screen display is extended to one side(or two or more sides) of the device. However, if the screen display isextended to one side (or two or more sides) of the device, there couldbe extra features, e.g., visual feedback to grip suppression areas or avisual prompt for gestures performed on the side of the device.

FIG. 9 shows a left hand gripping an adaptive enclosure device frombehind, where the fingers project onto the side sensors of the device.When a user grabs the mobile device, the user's fingers contact the sidetouch sensors of the device, such as the left touch sensors 930 and theright touch sensors 940. Therefore, the finger projection on the leftand right sides can be measured. Further, the fingers might also be intouch with the front touch sensor 935, with a projection that can beviewed as the natural spread from the side touch projection as shown inFIG. 9 .

Sometimes, when the device is thick in depth, there will not be fronttouches for 910-925. However, when users are holding the device tightlyor when users are stretching their thumb to reach something on thescreen display, there is a good chance to have a front touch like 905.

FIG. 10 shows how a finger projection area can be split into two areas.Specifically, the whole finger projection area on touch sensors can besplit into two areas:

Area #1: a finger projection 1010 on the side touch sensors 1045 of thedevice

Area #2: a projection 1005 on the front sensors 1035 of the device thatcan be considered as the natural spread of Area #1.

The adaptive enclosure can determine that the edge touch 1005 connectedto a related side touch, i.e., the “natural spread” part of the wholeprojection, is not a real touch-event and that the edge touch should besuppressed.

FIG. 22 shows an algorithm for a grip suppression interrupt routine fora side touch panel, according to one embodiment. The algorithm begins atS2200 and proceeds to S2210, at which the shapes made when fingerscontact the sides of the adaptive enclosure are stored. The logic in theadaptive enclosure then determines at S2220 whether any of the sidecontact shapes are adjacent to a front touch. If there are no shapesadjacent to a front touch, the side touch event is considered valid andthe side touch event is sent as input at S2250. The routine thenproceeds to S2260.

If it is determined at S2220 that there are side contact shapes adjacentto a front touch, the routine determines whether the front touch wasalready suppressed at S2230. If the front touch was already suppressed,the interrupt routine proceeds to S2260. If the front touch was notalready suppressed, then a front-touch cancel event is sent to suppressthe front touch at S2240. The interrupt routine ends at S2260.

FIG. 23 shows an algorithm for a grip suppression interrupt routine fora front touch panel, according to one embodiment. The algorithm beginsat S2300 and proceeds to determine at S2310 whether a distance from afront touch to an edge is less than or equal to an average fingertipsize (e.g., 8-10 mm). If the edge distance is determined at S2310 to begreater (i.e., is not less than or equal to) the average fingertip size,then the algorithm proceeds to S2340. If it is determined at S2310 thatthe edge distance is less than or equal to the average fingertip size,then the adaptive enclosure logic determines at S2320 whether the fronttouch is adjacent to any known side touch areas.

If the front touch is determined at S2320 to not be adjacent to anyknown side touch areas, then the algorithm proceeds to S2340. At S2340,the front touch event is sent (e.g., considered a valid input andprocessed accordingly), and the interrupt ends at S2350. However, if thefront touch is determined at S2320 to be adjacent to a known side toucharea, then the front touch and the side touch are suppressed at S2330,and the interrupt ends at S2350.

By combining the previous two interrupt routines, touch points in thecenter of the front touch panel will trigger a normal touch event. Touchpoints near to the edge (e.g., where the distance to the edge is lessthan or equal to an average fingertip size) will trigger a normal touchevent only if there is no adjacent side touch detected.

In one embodiment, if a user's finger contacts the front touch panelbefore the side touch panel, a touch-cancel event mechanism can recallthe previously-sent touch event.

The FIG. 8 buttons illustrate simply one example of two alternativeplacement locations of buttons related to an application. For example,while a music application is playing music, this alternative placementcan be one of many adaptation elements of the device. For example, adetermination of user interface placement and functionality by theadaptive enclosure can be based on variables such as: time of day,identification of user, location of user, grip of user,velocity/acceleration of user, heart rate of user, etc. These variablescan lead to a specific outcome of user interface placement andinteraction sensitivity. Additionally, although hand grip details andbutton placement are simply shown on the front surface of the adaptiveenclosure device 800, all sides of the device can be taken into accountfor UI placement as well as display elements shown on the device.

FIGS. 11A-11D illustrate another embodiment of an applicationinteraction with a user. In this example, the user is running a cameraapplication and raises the adaptive enclosure device 1100 for thepurpose of taking a picture. In this example, assume the entire frontsurface of the device is displaying the view that would be captured in apicture. The user has his thumbs placed in a spaced-apart position onthe front surface of the device. In some embodiments, holding theadaptive enclosure 1100 in a specific way in the context of having acamera application running will cause the UI to auto-populate the screenwith camera control buttons.

In FIG. 11B, the camera application, upon receiving thumb placementcontact information from the front sensor array, places a zoom sliderbutton 1102B right next to the left thumb location 1106 and places apicture capture button 1104B next to the right thumb location 1108. Thisplacement can be determined based on calculated logic of the handednessof the user as well as historical use of the camera app by thatparticular user. On the other hand, the placement can also beuser-defined.

In FIG. 11C, the placement of buttons are reversed. Specifically, thepicture capture button 1104C is placed near the left thumb location1106, and the zoom slider button 1102C is placed near the right thumblocation 1108. In an alternative embodiment, shown in FIG. 11D, thereare no visible buttons to show on the adaptive enclosure device 1100.Rather, the user's right hand can simply tap the device on the side 1110to capture a picture. A finger sliding on a side or front of the device(either up or down) can cause the picture or a preview to zoom out orin. Other instantiations of buttons (either displayed or not displayed)for functionality during such a camera application can be utilized, suchas continuous shooting. In yet other embodiments, the adaptive enclosurelogic 204 makes its own determination when to launch the cameraapplication based on a number of factors, such as by interpretingconversations, pointing one side of the device (e.g., the back) towardsa group of people while raising the device up to a user's eye level(e.g., as recognized by an opposing side camera), etc.

The adaptive enclosure logic (204 in FIG. 2 ) includes logic todetermine a depression of the surface of a capacitive touch sensor fromone pressure level to another pressure level in many embodiments. Once auser is identified based on grip/hold patterns, the adaptive enclosurelogic 204 can continuously monitor those hand press locations on thesurface. In many instances, this monitoring can indicate a finger ismoving across the surface of the device or has been removed from thesurface of the device or indicates that a greater deal of pressure isbeing placed by the hand/finger onto the surface.

FIG. 12 illustrates the normal layout of hard buttons 1210 and softbuttons 1205 of a mobile device when a user wants to control anapplication. FIG. 12 shows an example of a horizontal hard button andsoft button layout implemented in one embodiment when the adaptiveenclosure is held with both hands. Generally, the hard buttons 1210 arefor commonly used operations, and the soft buttons 1205 areapplication-specific.

In the embodiment illustrated in FIG. 12 , the buttons are laid outacross display 1200 in a horizontal manner from left to right. Thislayout works fine when a) a user is holding the device with both hands,and b) a user is holding the device with one hand, but the other hand isavailable. However, when a user, especially one whose hands are small,is holding the device with one hand (e.g., the user is holding a bagwith his left hand and is using his mobile device with his right hand),it can be difficult to touch the far-side soft/hard buttons, whichbrings about a less desirable user experience. This problem isexacerbated when a bigger display (often indicating a bigger devicesize) is used.

An adaptive button layout scheme equips a mobile system with sensors todetect whether the user is holding the device with both hands or onehand. If the device is held with just one hand, the sensors can alsodetect which hand is holding the device. This detection can be achievedas detailed previously or by adding a few pressure or temperaturesensors on the device.

After the system gathers information about the hand or hands holding thedevice, the system can layout the soft buttons adaptively. For example,when the user is holding the device with both hands, the horizontallayout scheme illustrated in FIG. 12 is selected. When the user isholding the device with a right hand, the soft button layout should beright-hand-oriented so that all soft buttons are within reach of theright hand fingers (e.g., the thumb). The same principle applies whenthe user is holding the device with his left hand.

FIG. 13 illustrates a scenario in which the adaptive enclosure is heldby a user's right hand. In this scenario, a hard button 1310 distantfrom a user's hand (e.g., the leftmost hard button) is emulated as asoft button 1315 in the display 1300. Both the emulated hard button 1315and soft buttons 1305 are displayed in a vertical column on the rightside of the display 1300.

With sensors 1320 in the adaptive enclosure, a processor can determinethat the adaptive enclosure is being held by a right hand. Thus, theprocessor can perform an adaptive switch of the button layout (e.g.,between the horizontal layout of FIG. 12 and the vertical layout of FIG.13 ) in a real-time manner.

When the user is holding the device with only one hand, the other handmight not be occupied. For example, some users like to hold the devicewith their right hand and touch the display with their left hand. Inthis case, a layout scheme change is not required. Thus, a user's inputcan be used to indicate a scenario where only one hand is available. Oneexample embodiment uses a notification bar switch to add a “one handmode” switch there. The user can thus operate the switch to indicateone-hand or both-hand modes.

Another way is to use a one-hand-oriented button layout when one-handholding is detected and switch to both-hand mode when a touch that isout of the holding hand's reach is detected (implying the other hand isactually available). The layout will switch back to one-hand mode againwhen a touch out of the reach of the holding hand has not been detectedfor a threshold time.

Because the size of people's hands is different, some embodiments layout the buttons for all hand sizes. One example solution is a buttonring as illustrated in FIG. 14 . FIG. 14 shows an implementation of abutton ring 1430, including soft buttons and emulated hard buttons, inaccordance with one embodiment. The button ring organizes the buttonsfor a one-hand scenario. The buttons can be scrolled in/out of thedisplay and the button-push area (a subset of the displayed buttons) atthe right side of the display and can be reached by a thumb of a hand ofany size. The user uses his thumb to slide the ring to get a desiredbutton in the button-push area 1425 and pushes the button to issue acommand. FIG. 14 illustrates an example implementation for the adaptiveenclosure being held by a right hand. In FIG. 14 , soft button s1 andsoft button s2 are scrolled out of the display, and soft buttons s3 ands4, as well as emulated hardware button h3, are displayed outside of thebutton-push area. Further, soft buttons s5, s6, and s7, as well asemulated hard buttons h1 and h2, are displayed within the button-pusharea. In some embodiments, s3 and s4 are only partially displayed or aredisplayed translucently or grayed-out to indicate they are outside ofthe button-push area.

This scheme does not increase the cost or the power consumptionsignificantly. Temperature or pressure sensors to determine the handholding the device are not expensive, and these sensors will only add asmall percent to the total device cost. As for power, since the userwill likely not change his holding manner frequently, the sensors can beswitched off most of the time.

FIG. 15 illustrates an embodiment of a determinative algorithm for achange in contact point pressure on the adaptive enclosure. There areseveral methodologies to determine such an interaction, including ameasurement of a given surface contact area and a determination of achange between a standard contact area amount and a pressurized contactarea amount. For example, if a fingertip is casually resting on thesurface at location 1500, the fingertip contact point can be dynamicallymeasured for an area of contact of the fingertip on the capacitivesurface: a rudimentary surface approximation multiplies the biggest Xwidth of the fingertip contact by the biggest Y height of the fingertipcontact, shown in inset 1502. There are more complex and accuratemeasurement techniques that can be implemented.

Logic frequently updates this contact area, once it has been measured,to determine whether the user is pressing down more firmly, therebyincreasing the area. This updating can be periodic, random, or canchange based on, e.g., a magnitude of the pressure or a rate at whichthe pressure has recently changed. In calculation 1004, the changedwidth X+ΔX and the changed height Y+ΔY create a new area that iscompared by the logic with the earlier area to see a changed area. Ifthe changed area surpasses a threshold amount, the adaptive enclosurelogic 204 can interpret the difference as a specific finger press toindicate a function result. For example, a user might have his thumb ona portion of a surface of the device to hold the device in place in apicture mode. Then the user exerts an amount of force on his thumb topress into the screen. The adaptive enclosure logic 204 can determinethat a picture capture event is to take place based on the change inarea of the fingertip.

The example in FIG. 15 simply shows a single fingertip contact area. Inother embodiments, all contact locations for a hand are measured(fingers, palm, etc.), and the same area calculations take place on allsides of the device. If a significant gripping force increase takesplace, the adaptive enclosure logic (potentially specifically the gripdetection logic 300) can determine that a user-specific interaction withthe adaptive enclosure is taking place. This interaction can be in theform of a squeeze event. In many embodiments, such a squeeze event canreplace a home button that is or would otherwise be physically on thedevice. In some embodiments, the logic can determine squeezing gesturesbased on an area of hand contact change, as discussed above. In otherembodiments, the logic and pressure sensors within the device candetermine a squeeze event being exerted on the external structure of thedevice without requiring an area calculation by basing suchdetermination on a change in pressure or temperature.

As discussed in FIG. 11A-11D, when a graphical picture is displayed on asurface of the adaptive enclosure device (e.g., a view from anintegrated camera to set up a picture), the picture was described asshown across the entire surface of the front side of the device. Inother embodiments, the picture shown can adapt to the way in which theuser is holding the device. FIGS. 16A, 16B, and 16C describe anembodiment in which the user holds the device, the thumb contacts thedevice, and the visual display of what is seen by the camera dynamicallyadapts to not obscure the view of the picture with the thumb placements.

In FIG. 16A, the thumb placement contacts 1604 and 1606 are in the sameplacement on the front side of the adaptive enclosure 1600 as they arein FIG. 11A. In this scenario, the logic adapts the display screen 1602to fit between the two thumbs.

In FIG. 16B, thumb placement contact 1608 has moved left to be onlypartially on the edge of the front side of adaptive enclosure 1600,while thumb placement contact 1610 is in the same placement on the frontside. In this scenario, the logic adapts the display screen 1612 byexpanding it to the left (in relationship to the size of the screen1602) to create a bigger image. This expansion can be by way ofexpanding the ratio of display pixels per photo pixel or by maintainingthe ratio and displaying pixels corresponding to additional photopixels.

In FIG. 16C, thumb placement contact 1614 has stayed in the same placerelative to FIG. 16B, but thumb placement contact 1616 has moved rightto be only partially on the edge of the front side of adaptive enclosure1600. In this scenario, the logic adapts the display screen 1618 byexpanding it to the right (in relationship to the size of the screen1602 and screen 1612) to create an even bigger image.

FIG. 16D and FIG. 16E describe an embodiment of the adaptive enclosurelogic allowing for the display screen to be covered by certain fingertipcontact points. For example, in FIG. 16D, the logic allows for portionsof the screen 1624 to be covered by both left and right thumb placementcontacts 1620 and 1622. In FIG. 16E, the logic allows only for leftthumb contact point 1626 to cover a portion of display screen 1630,while keeping right thumb contact point 1628 clear of the screen.Accordingly, the adaptive enclosure logic shrinks the right side ofdisplay screen 1630 to compensate. In some embodiments, whether the leftor right thumb contact point is cleared of the screen is based on thehandedness of the user, which can be determined by a user input or bylearning algorithms within self-learning logic (210 in FIG. 2 ). In someembodiments, the zoom, picture capture control (discussed above), andany number of other functional buttons are displayed in the non-displayscreen area (such as the area around thumb contact point 1628 in FIG.16E).

FIG. 17A and FIG. 17B describe an embodiment of interaction with a 3Dobject using the adaptive enclosure device 1700. In FIG. 17A, a cube1702 is shown displayed on the front display of the adaptive enclosuredevice 1700. A copy of the cube is also shown to the right of FIG. 17Afor a non-obstructed view. The cube 1702 is displayed in a 3D spacewithin the device. In many embodiments where there is also a display onthe back side (not shown) of the adaptive enclosure device 1700, thesame cube can be seen from the other direction. A user can press a firstfinger 1704 (the thumb in this example) on the front of the device and asecond finger 1706 (the index finger, shown with dotted lines becausethe adaptive enclosure device would be obscuring the finger) on the backof the device, as shown in FIG. 17A.

When the first and second fingers 1704, 1706 are placed on the surfacesof the adaptive enclosure device, the adaptive enclosure logic candetermine the gesture is meant to select the object in 3D space, whichcan unlock a 3D object rotation feature. For example, if the user simplycontacts the device with the first finger 1704 on the front side of thedevice, this contact can alternatively unlock a 3D object movementfeature. As an example of such a feature, the object attaches to thefinger contact and moves around the screen under the user's first finger1704 as he slides his first finger 1704 around the screen. On the otherhand, if the object selection contact is with two fingers, on the frontside (e.g., with finger 1704) and on the back side (e.g., with finger1706) then the 3D object rotation feature can be selected.

With the 3D object rotation feature, as shown in FIG. 17B, the usermoves/slides/swipes the first finger 1704 in one direction 1708 andmoves/slides/swipes the second finger 1704 in the opposite direction1710. This front and back side simultaneous movement at adaptiveenclosure surface points in contact with the front and back side of thecube 1702 can cause the cube to rotate (as seen in the cube 1702perspective difference between FIG. 17A and FIG. 17B) in a similardirection as if the cube were a real object and the user was pinchingthe cube and moving his fingers in the same manner.

As can be seen in FIG. 17A and FIG. 17B, the user can estimate where hissecond finger 1706 comes in contact with the back side of the adaptiveenclosure device. The finger is shown in a dotted line, but in areal-world scenario, would not necessarily be so shown because thedevice would obscure the finger.

FIG. 18A-18D illustrate a backside pointer implementation for theadaptive enclosure device to allow for a more precise back side pointercontact location. The backside pointer allows for a helpful pointersystem so the user knows where his finger(s) is located.

For certain applications, a virtual pointer or cursor can be created anddisplayed upon a determination that a finger is within a predefinedrange of the back side surface of the adaptive enclosure device. Thisrange is sometimes considered solely in the depth direction of theadaptive enclosure device, but some embodiments also consider ranges inthe length or width directions of the device. The distance that a fingeris tracked can depend on the sensitivity of the capacitive sensor arrayon the back side of the device. In certain embodiments, the sensitivityof the readings of the capacitive sensor array on the back side of thedevice is increased in applications where a backside pointer isutilized. Additionally, the finger tracking mechanism for the backsidepointer can also utilize other sensors and/or a camera in the device inaddition to the backside capacitive sensor array.

The virtual pointer can be in the form of a circle. The size of thecircle can be a function of the distance from the finger to the backside surface of the device. When the finger moves closer to the backside surface, the pointer circle becomes smaller. In many embodiments,when the finger finally makes contact with the back cover, the pointerresolves to a minimum size to pinpoint the smallest objects displayed onthe screen. Of course, the virtual pointer can take other shapes, suchas an oval (or fingerprint), a rectangle, a triangle, a star, or anyother shape.

This backside pointer implementation can be used for clicking on theback side of the device when the virtual pointer locates an object toclick on. The user can move his finger away after the pointer finds theclickable object. In different embodiments, the click operation launchesan application, selects a menu item, clicks on a link to a web page,etc., in a manner understood by the skilled artisan.

FIG. 18A-18D show two separate viewpoints of a single backside pointerinteraction. The left side of each figure shows the display screen onthe front side of the adaptive enclosure device 1800. The right side ofeach figure shows a side view of the adaptive enclosure device and afinger approaching the rear side of the device.

FIG. 18A shows how the backside pointer can begin operation. At acertain distance from the back surface 1802, for example a distance X,the adaptive enclosure device 1800 picks up the proximate location ofthe finger and displays a form of a circle 1806 on the front sidedisplay. In some embodiments, this type of pointer interface is onlyavailable when running certain applications on the adaptive enclosuredevice 1800.

Additionally, the adaptive enclosure logic can interpret several fingerson or near the back side of the device and determine which of thosefingers is a certain finger used for a backside pointer operation. Forexample, using grip detection logic, the device can automaticallyeliminate other fingers from consideration when determining the displayof the backside pointer.

As stated, the further away from the device the user's finger 1804 is,the larger the pointer circle is. As the finger approaches the back sidesurface, as shown in FIGS. 18B, 18C, and 18D, the pointer circle narrowsin circumference until the finger is in contact with the surface of thedevice and the pointer selection area is quite minimal. In manyembodiments, this allows the user to guide his finger to the correctlocation to select and interact with an object, such as cube 1808, whichis shown along with the backside pointer circles, on the front sidedisplay of the adaptive enclosure device 1800.

The adaptive enclosure can allow a user to touch and to move a cursor ofan application without the user's finger blocking the target point onthe front screen.

FIG. 19 is a flow diagram of an embodiment of a process to provide acustom user interface on the adaptive enclosure device. The process isperformed by processing logic that can be located in hardware, software,firmware, or a combination thereof.

The process begins at S1900 and proceeds to S1905 at which theprocessing logic receives user contact data input from at least twotouch sensor arrays on two different sides of an adaptive enclosuredevice. In many embodiments, more than one array on more than one sideof an adaptive enclosure device is utilized. In other embodiments, asingle array on one side of the adaptive enclosure device is utilized.In yet other embodiments, a single array that spans more than one sideof the adaptive enclosure device is utilized.

The process continues with the processing logic providing, at S1910, auser interface custom to the user on the adaptive enclosure device basedon at least some of the user contact data received at S1905. In manyembodiments, context information (e.g., time of day, ID of user, outsidetemperature, amount of sunlight hitting the device, heart rate of user,location of device, speed relative to the ground of the device,acceleration of the device, presence of other devices in the vicinity ofthe device, application(s) active on the device, presence of otherpeople in the vicinity of the device, ambient noise near the device,etc.) is used in addition to the contact data input from sensor arrayson the device to help with determining the custom UI. The processconcludes at S1920.

FIG. 20 is a flow diagram of an embodiment of a process to identify theuser of the adaptive enclosure device through the use of grip detectionlogic. The process is performed by processing logic that can be locatedin hardware, software, firmware, or a combination thereof.

The process begins at S2000 and proceeds to S2005 at which theprocessing logic receives grip detection data from at least two touchsensor arrays on two different sides of an adaptive enclosure device.Again, although this particular process utilizes at least two arrays forinput, in other embodiments, there is only one array involved (e.g., ona single side of the device or one array being present on multiple sidesof the device). Furthermore, the grip detection logic can also utilizeother adaptive enclosure logic, such as back, side, or front touchgesture logic.

The process continues with the processing logic identifying at S2010 auser who is gripping the adaptive enclosure device, based at least inpart on at least some of the grip detection data received. In manyembodiments, the identification is based on a stored database of pastgrips. Grips of certain users can be initially identified throughtraining or general usage over time. The adaptive enclosure device logiccan simply train itself through normal use by one or more users. Once alarge enough data set is present to make grip comparisons against, thelogic can intelligently determine the user based on a similarity ofgrip. Of course, a dedicated training application can also beimplemented. The grip, as discussed above, includes data related to theside of the fingers/palm, the pressure of the grip, the spacing of thecontact points, etc.

FIG. 24 shows an algorithm for determining how positions on a backsensor are mapped to a requested number of inputs. For example, thealgorithm can be used to divide the sensor array on the back of thedevice into a number of inputs requested by different video games. Thealgorithm begins at S2400 and proceeds to S2410. At S2410, a number ofinputs is received from an app, such as a video game.

At S2420, it is determined whether the number of inputs is less thanthree. If the number of inputs is less than three, then there issufficient room for each of the portions to extend across the entiretyof the back sensor. Thus, if the number of inputs is determined to beless than three, the algorithm divides the back sensor into a number ofcolumns or rows equal to the number of inputs at S2430. Thus, if onlyone input is required, the entire back sensor can be used as a buttontriggering that input. If only two inputs are required, then the backsensor can be divided into two approximately equal portions, such as bybisecting the length of the sensor. This bisecting permits a user to usehis or her index fingers to activate the appropriate button. If threeinputs are requested, then the back sensor is divided into threeapproximately equal portions. This division permits a user to activate abutton with his or her middle finger.

If it is determined at S2420 that the number of inputs is not less thanor equal to three (i.e., is greater than three), then it is determinedif the number of inputs is even at S2440. If it is determined at S2440that the number of inputs is even, then, in one embodiment, the backsensor is divided into a grid having two rows and a number of columnsequal to half the number of requested inputs at S2450. For example, ifsix inputs are requested, then the back sensor has two rows and threecolumns. In another embodiment, the number of columns is equal to two,and the number of rows is equal to half the number of inputs.

If the number of inputs is determined at S2440 not to be even (i.e., isodd), then the back sensor is divided at S2460 into three rows, in oneembodiment. The outer two rows are then divided into a number of columnsequal to half the number of requested inputs, rounded down. The middlerow is then used as a single input. In another embodiment, the backsensor is divided at S2460 into three columns, where the outer twocolumns are divided into a number of rows equal to half the number ofrequested inputs, rounded down. In a further embodiment, the middle row(or column) is used for more than a single input.

The algorithm concludes at S2470.

Once the back sensor has been divided into an appropriate number ofsections, control is returned to the requesting app. In someembodiments, the app will assign inputs (e.g., the activated weaponrydescribed in Table 1) to the sections. In other embodiments, the appwill allow a user to map each section to a different input.

FIG. 21 illustrates an embodiment of a computing device thatincorporates the adaptive enclosure. The computing device, in manyembodiments, comprises a system-on-a-chip (SoC) package 2100 design,which combines processor, graphics, memory, and I/O control logic intoone SoC package. Thus, in FIG. 21 , processor core(s) 2102, graphicscore(s) 2104, their respective caches (2106 and 2108) are all present inthe package, along with memory subsystem 2112 and I/O subsystem 2130.

Although not shown, each processor core can internally include one ormore instruction/data caches, execution units, prefetch buffers,instruction queues, branch address calculation units, instructiondecoders, floating point units, retirement units, etc. Each core presentis located on a processor semiconductor die. For each logic unit shownother than the core(s) 2102 in the SoC Package 2100, the logic unit canbe on the processor core(s) 2102 semiconductor die in some embodimentsor on another die in other embodiments. If a given logic unit is not onthe same die as processor core(s) 2102, that logic unit would be on adifferent semiconductor die, though in the same SoC package 2100, whichcan include several dies communicatively coupled with each other in thepackage.

The SoC 2100 also includes at least one lower level processor cache,such as processor cache 2106. This cache can be a general purpose cachecapable of storing a significant amount of data retrieved from memorylocations in volatile memory 2118 and/or non-volatile memory 2120. Indifferent embodiments, processor cache 2106 is shared among all cores,or each core can have its own lower level cache.

One or more graphics core(s) 2104 are also included in SoC package 2100as well as a lower level graphics cache 2108 which can storegraphics-related data for the graphics core(s) 2104 to work on. Graphicscore(s) 2104 can internally include one or more execution units and oneor more instruction and data caches utilized to feed the execution unitswith information to process. Additionally the graphics core(s) 2104 cancontain other graphics logic units that are not shown in FIG. 21 , suchas one or more vertex processing units, rasterization units, mediaprocessing units, and codecs among others. For the sake of simplicity,the specific logic within the graphics core(s) 2104 is not shown.

The graphics core(s) 2104 provide data to be displayed. In manyembodiments, the graphics core(s) 2104 sends data to a displaycontroller 2124, which in turn populates one or more displays 2126coupled to the system.

SoC package 2100 can also include a power control unit (PCU) 2110. ThePCU 2110 can include logic and components needed for regulating thepower state of the core(s) among other tasks. The PCU 2110 can includeone or more voltage regulators (VRs).

In FIG. 21 , the SoC package 2100 also includes a memory subsystem 2112that has an integrated volatile memory controller 2114 that can beutilized to provide access to volatile memory 2118. Volatile memorycontrol 2114 can receive a memory access request from a core and routethat request to volatile memory 2118. Likewise, non-volatile memorycontrol 2116 can receive a memory access request from a core and routethat request to non-volatile memory 2120.

In many embodiments, an input/output (I/O) subsystem 2130 is present inthe system in FIG. 21 to communicate with I/O devices, such as I/Odevice(s) 2134. The I/O subsystem 2130 in FIG. 21 can be integrated intothe SoC package 2100. Within the I/O subsystem 2130, one or more I/Oadapter(s) 2132 are present to translate a host communication protocolutilized within the processor core(s) 2102 to a protocol compatible withparticular I/O devices. Some of the protocols for which adapters can beutilized for translation include Peripheral Component Interconnect(PCI)-Express (PCI-E), 3.0; Universal Serial Bus (USB), 3.0; SerialAdvanced Technology Attachment (SATA), 3.0; Small Computer SystemInterface (SCSI), Ultra-640; and Institute of Electrical and ElectronicsEngineers (IEEE) 1594 “Firewire;” among others.

Additionally, there can be one or more wireless protocol I/O adapters.Examples of wireless protocols, among others, are used in personal areanetworks, such as IEEE 802.15 and Bluetooth, 4.0; wireless local areanetworks, such as IEEE 802.11-based wireless protocols; and cellularprotocols

A Basic Input/Output System (BIOS) flash device 2136 can additionally bepresent in the system to provide a set of boot instructions when thesystem powers on or reboots. For BIOS flash device 2136, some of theprotocols for which the I/O adapters 2134 can translate include SerialPeripheral Interface (SPI) and Microwire, among others.

In many embodiments, one or more sensor arrays 2122 also are coupled tothe I/O subsystem 2130. The sensor arrays 2122 can include thecapacitive touch sensor arrays as described above.

In different embodiments, the adaptive enclosure logic (AEL), describedin detail above, can be present in hardware logic 2128A, in softwarelogic 2128B, in firmware logic 2128C, or in a combination of theselocations.

Processor core(s) 2102 are examples of processing means for executingthe various algorithms set forth in this description. Caches 2106, 2108,volatile memory 2118, non-volatile memory 2120, and flash device 2136are examples of storing means for storing various instructions andvariables described in this disclosure. Examples of a sensing meansinclude sensor arrays 2122, pressure and temperature sensors, andcameras. Display 2126 is an example of a displaying means that displaysthe images and other outputs described above.

The algorithms described above can be stored in a transitory medium or anon-transitory medium. A transitory medium can include a propagatingwave (including an electromagnetic wave), a signal traveling along awire (such as a telephone line or an ISDN connection), and softwareinstructions absent a processor. A non-transitory medium includes caches2106, 2108, volatile memory 2118, non-volatile memory 2120, and flashdevice 2136. A non-transitory medium can include a read-only memory(ROM), a random access memory (RAM), a hard drive (including, but notlimited to, magnetic or solid state), an optical disc (e.g., a CD-ROM, aDVD, or a Blu-Ray disc), an optomagnetic disc, and a flash memory.

In addition, the mobile devices described herein can receive and installsoftware to execute the algorithms previously set forth. In such a case,the device can receive software (e.g., a software package) over awireless connection (e.g., a Bluetooth or a 3G or 4G connection) from aserver. In such a case, the package received by the mobile deviceproduces (e.g., upon installation) the software that executes thealgorithms and does not necessarily itself execute the algorithms.

Further, the computing device shown in FIG. 21 can include a battery.Such a power source is particularly advantageous in an embodiment inwhich the computing device is portable. Although the battery can benon-rechargeable, the battery is typically rechargeable, such as by wayof a jack on one of the sides of the computing device.

Numerous other changes, substitutions, variations, alterations, andmodifications may be ascertained to one skilled in the art. It isintended the present disclosure encompass all such changes,substitutions, variations, alterations, and modifications as fallingwithin the scope of the appended claims. To assist the United StatesPatent and Trademark Office (USPTO) and, additionally, any readers ofany patent issued on this application in interpreting the claimsappended hereto, Applicants wish to note the Applicants: (a) do notintend any of the appended claims to invoke 35 U.S.C. section 112(f) asit exists on the date of the filing hereof unless the words “means for”or “step for” are specifically used in the particular claims; and (b) donot intend, by any statement in the specification, to limit thisdisclosure in any way that is not otherwise reflected in the appendedclaims.

The following examples pertain to some embodiments of the disclosure.

Example 1 is a device to receive user inputs, comprising: an enclosureincluding a plurality of capacitive touch sensor arrays disposed atleast on two of a top side, a bottom side, a left side, a right side, afront side, and a back side of the device, and a first display on thefront side of the device; and logic configured to receive touchinteraction information from the plurality of capacitive touch sensorarrays, and to initiate an action based at least in part on the touchinteraction information.

In Example 2, the subject matter of Example 1 can optionally include thefirst display including a first capacitive touch sensor array of theplurality of capacitive touch sensor arrays, and the enclosure furtherincluding, on the back side of the device, a second display at leastwith a second capacitive touch sensor array of the plurality ofcapacitive touch sensor arrays.

In Example 3, the subject matter of Example 1 or 2 can optionallyinclude the logic being further configured to identify a user bydetecting a grip of the enclosure.

In Example 4, the subject matter of any one of Examples 1-3 canoptionally include the logic being further configured to ignore aportion of the touch interaction information in response to adetermination that the portion is a result of hand jitter, at least inpart based on the touch interaction information.

In Example 5, the subject matter of any one of Examples 1-4 canoptionally include the logic being further configured to identify a userusing a usage model learned at least in part based on the touchinteraction information.

In Example 6, the subject matter of any one of Examples 1-5 canoptionally include the logic being further configured to implement abackside pointer in response to a determination that a finger is withina predetermined distance from the back side of the device.

In Example 7, the subject matter of any one of Examples 1-6 canoptionally include the logic receiving the touch interaction informationfrom a functional button displayed on the device in two or moredifferent locations of the enclosure.

In Example 8, the subject matter of any one of Examples 1-7 canoptionally include the touch interaction information including a swipein one direction on the front side of the device and a swipe in theopposite direction on the back side of the device, and the logic beingfurther configured to rotate a three-dimensional object at least in partbased on the swipe in the one direction and the swipe in the oppositedirection.

In Example 9, the subject matter of any one of Examples 1-8 canoptionally include the touch interaction information including a hold onthe back side of the device and a swipe on the front side of the device,and the logic being further configured to manipulate an image at leastin part based on the hold and the swipe.

In Example 10, the subject matter of any one of Examples 1-9 canoptionally include the touch interaction information including a swipeacross the back side of the device, and the logic being furtherconfigured to roll a three-dimensional object on the first display atleast in part based on the swipe.

In Example 11, the subject matter of any one of Examples 1-10 canoptionally include the logic being further configured to initiate a sameaction based on a swipe received on the back side of the device as anaction initiated based on a swipe received on the front side of thedevice.

In Example 12, the subject matter of any one of Examples 1-11 canoptionally include at least one of the top side, the bottom side, theleft side, and the right side including a second display.

In Example 13, the subject matter of any one of Examples 1-12 canoptionally include the logic being further configured to cancel touchinteraction information received from a touch on the front side of thedevice in response to a determination that the touch is adjacent to atouch on the left side or the right side of the device.

In Example 14, the subject matter of any one of Examples 1-13 canoptionally include the first display displaying an emulated hardwarebutton along a side of the first display.

In Example 15, the subject matter of any one of Examples 1-14 canoptionally include the touch interaction information including a pressagainst the front side of the enclosure and a press against the backside of the enclosure, and the logic being further configured to deforma three dimensional object on the first display at least in part basedon the press against the front side of the enclosure and the pressagainst the back side of the enclosure.

In Example 16, the subject matter of any one of Examples 1-15 canoptionally include the logic being further configured to divide acapacitive touch sensor array on the back side of the enclosure into aplurality of sections, in response to a determination that a number ofinputs is less than three.

Example 17 is method to receive user inputs, comprising: receiving touchinteraction information from a plurality of capacitive touch sensorarrays disposed at least on two of a top side, a bottom side, a leftside, a right side, a front side, and a back side of an enclosure, theenclosure including a display on the front side of the enclosure; andinitiating one or more actions based at least in part on the receivedtouch interaction information.

In Example 18, the subject matter of Example 17 can optionally includethe display including a first capacitive touch sensor array of theplurality of capacitive touch sensor arrays, and the enclosure furtherincluding, on the back side, another display at least with a secondcapacitive touch sensor array of the plurality of capacitive touchsensor arrays.

In Example 19, the subject matter of Example 17 or 18 can optionallyinclude identifying a user by detecting a grip of the enclosure.

In Example 20, the subject matter of any one of Examples 17-19 canoptionally include ignoring a portion of the touch interactioninformation in response to a determination that the portion is a resultof hand jitter, at least in part based on the touch interactioninformation.

In Example 21, the subject matter of any one of Examples 17-20 canoptionally include identifying a user using a usage model learned atleast in part based on the touch interaction information.

In Example 22, the subject matter of any one of Examples 17-21 canoptionally include implementing a backside pointer in response to adetermination that a finger is within a predetermined distance from theback side of the enclosure.

In Example 23, the subject matter of any one of Examples 17-22 canoptionally include the touch interaction information being received froma functional button displayed on the enclosure in two or more differentlocations of the enclosure.

In Example 24, the subject matter of any one of Examples 17-23 canoptionally include the touch interaction information including a swipein one direction on the front side of the enclosure and a swipe in theopposite direction on the back side of the enclosure, and athree-dimensional object on the display being rotated at least in partbased on the swipe in the one direction and the swipe in the oppositedirection.

In Example 25, the subject matter of any one of Examples 17-24 canoptionally include the touch interaction information including a hold onthe back side of the enclosure and a swipe on the front side of theenclosure, and an image on the display being manipulated at least inpart based on the hold and the swipe.

In Example 26, the subject matter of any one of Examples 17-25 canoptionally include the touch interaction information including a swipeacross the back side of the enclosure, and a three-dimensional object onthe display being rolled at least in part based on the swipe.

In Example 27, the subject matter of any one of Examples 17-26 canoptionally include initiating a same action based on a swipe received onthe back side of the enclosure as an action initiated based on a swipereceived on the front side of the enclosure.

In Example 28, the subject matter of any one of Examples 17-27 canoptionally include at least one of the top side, the bottom side, theleft side, and the right side including a second display.

In Example 29, the subject matter of any one of Examples 17-28 canoptionally include canceling touch interaction information received froma touch on the front side of the enclosure in response to adetermination that the touch is adjacent to a touch on the left side orthe right side of the enclosure.

In Example 30, the subject matter of any one of Examples 17-29 canoptionally include displaying an emulated hardware button along a sideof the display.

In Example 31, the subject matter of any one of Examples 17-30 canoptionally include the touch interaction information including a pressagainst the front side of the enclosure and a press against the backside of the enclosure, and a three dimensional object on the firstdisplay being deformed at least in part based on the press against thefront side of the enclosure and the press against the back side of theenclosure.

In Example 32, the subject matter of any one of Examples 17-31 canoptionally include dividing a capacitive touch sensor array on the backside of the enclosure into a plurality of sections, in response to adetermination that a number of inputs is less than three.

Example 33 is a non-transitory computer readable medium that storesinstructions that, when executed by a processor, cause the processor toperform a method to receive user inputs comprising: receiving touchinteraction information from a plurality of capacitive touch sensorarrays disposed at least on two of a top side, a bottom side, a leftside, a right side, a front side, and a back side of an enclosure; andinitiating one or more actions based at least in part on the receivedtouch interaction information.

In Example 34, the subject matter of Example 33 can optionally includethe front side including a first display including a first capacitivetouch sensor array of the plurality of capacitive touch sensor arrays,and the enclosure further including, on the back side, a second displayat least with a second capacitive touch sensor array of the plurality ofcapacitive touch sensor arrays.

In Example 35, the subject matter of Example 33 or 3 can optionallyinclude the method further comprising: identifying a user by detecting agrip of the enclosure.

In Example 36, the subject matter of any one of Examples 33-35 canoptionally include the method further comprising: ignoring a portion ofthe touch interaction information in response to a determination thatthe portion is a result of hand jitter, at least in part based on thetouch interaction information.

In Example 37, the subject matter of any one of Examples 33-36 canoptionally include the method further comprising: identifying a userusing a usage model learned at least in part based on the touchinteraction information.

In Example 38, the subject matter of any one of Examples 33-37 canoptionally include the method further comprising: implementing abackside pointer in response to a determination that a finger is withina predetermined distance from the back side of the enclosure.

In Example 39, the subject matter of any one of Examples 33-38 canoptionally include the touch interaction information being received froma functional button displayed on the enclosure in two or more differentlocations of the enclosure.

In Example 40, the subject matter of any one of Examples 33-39 canoptionally include the touch interaction information including a swipein one direction on the front side of the enclosure and a swipe in theopposite direction on the back side of the enclosure, and athree-dimensional object on a display on the front side of the enclosurebeing rotated at least in part based on the swipe in the one directionand the swipe in the opposite direction.

In Example 41, the subject matter of any one of Examples 33-40 canoptionally include the touch interaction information including a hold onthe back side of the enclosure and a swipe on the front side of theenclosure, and an image on a display on the front side of the enclosurebeing manipulated at least in part based on the hold and the swipe.

In Example 42, the subject matter of any one of Examples 33-41 canoptionally include the touch interaction information including a swipeacross the back side of the enclosure, and a three-dimensional object ona display on the front side of the enclosure being rolled at least inpart based on the swipe.

In Example 43, the subject matter of any one of Examples 33-42 canoptionally include the method further comprising: initiating a sameaction based on a swipe received on the back side of the enclosure as anaction initiated based on a swipe received on the front side of theenclosure.

In Example 44, the subject matter of any one of Examples 33-43 canoptionally include the front side of the enclosure including a firstdisplay, and at least one of the top side, the bottom side, the leftside, and the right side including a second display.

In Example 45, the subject matter of any one of Examples 33-44 canoptionally include the method further comprising: canceling touchinteraction information received from a touch on the front side of theenclosure in response to a determination that the touch is adjacent to atouch on the left side or the right side of the enclosure.

In Example 46, the subject matter of any one of Examples 33-45 canoptionally include the method further comprising: displaying an emulatedhardware button along a side of a display on the front side of theenclosure.

In Example 47, the subject matter of any one of Examples 33-46 canoptionally include the touch interaction information including a pressagainst the front side of the enclosure and a press against the backside of the enclosure, and a three dimensional object on a display onthe front side of the enclosure being deformed at least in part based onthe press against the front side of the enclosure and the press againstthe back side of the enclosure.

In Example 48, the subject matter of any one of Examples 33-47 canoptionally include the method further comprising: dividing a capacitivetouch sensor array on the back side of the enclosure into a plurality ofsections, in response to a determination that a number of inputs is lessthan three.

Example 49 is a device to receive user inputs, comprising: an enclosureincluding a sensing means disposed at least on two of a top side, abottom side, a left side, a right side, a front side, and a back side ofthe device, and a first displaying means on the front side of thedevice; and processing means for receiving touch interaction informationfrom the sensing means, and for initiating an action based at least inpart on the touch interaction information.

In Example 50, the subject matter of Example 49 can optionally includethe first displaying means including a first sensing means of thesensing means, and the enclosure further including, on the back side ofthe device, a second displaying means at least with a second sensingmeans of the sensing means.

In Example 51, the subject matter of Example of 49 or 50 can optionallyinclude the processing means identifying a user by detecting a grip ofthe enclosure.

In Example 52, the subject matter of any one of Examples 49-51 canoptionally include the processing means ignoring a portion of the touchinteraction information in response to a determination that the portionis a result of hand jitter, at least in part based on the touchinteraction information.

In Example 53, the subject matter of any one of Examples 49-52 canoptionally include the processing means identifying a user using a usagemodel learned at least in part based on the touch interactioninformation.

In Example 54, the subject matter of any one of Examples 49-53 canoptionally include the processing means implementing a backside pointerin response to a determination that a finger is within a predetermineddistance from the back side of the device.

In Example 55, the subject matter of any one of Examples 49-54 canoptionally include the processing means receiving the touch interactioninformation from a functional button displayed on the device in two ormore different locations of the enclosure.

In Example 56, the subject matter of any one of Examples 49-55 canoptionally include the touch interaction information including a swipein one direction on the front side of the device and a swipe in theopposite direction on the back side of the device, and the processingmeans rotating a three-dimensional object at least in part based on theswipe in the one direction and the swipe in the opposite direction.

In Example 57, the subject matter of any one of Examples 49-56 canoptionally include the touch interaction information including a hold onthe back side of the device and a swipe on the front side of the device,and the processing means manipulating an image at least in part based onthe hold and the swipe.

In Example 58, the subject matter of any one of Examples 49-57 canoptionally include the touch interaction information including a swipeacross the back side of the device, and the processing means rolling athree-dimensional object on the first displaying means at least in partbased on the swipe.

In Example 59, the subject matter of any one of Examples 49-58 canoptionally include the processing means initiating a same action basedon a swipe received on the back side of the device as an actioninitiated based on a swipe received on the front side of the device.

In Example 60, the subject matter of any one of Examples 49-59 canoptionally include at least one of the top side, the bottom side, theleft side, and the right side including a second displaying means.

In Example 61, the subject matter of any one of Examples 49-60 canoptionally include the processing means canceling touch interactioninformation received from a touch on the front side of the device inresponse to a determination that the touch is adjacent to a touch on theleft side or the right side of the device.

In Example 62, the subject matter of any one of Examples 49-61 canoptionally include the first displaying means displaying an emulatedhardware button along a side of the first displaying means.

In Example 63, the subject matter of any one of Examples 49-62 canoptionally include the touch interaction information including a pressagainst the front side of the enclosure and a press against the backside of the enclosure, and the processing means deforming a threedimensional object on the first displaying means at least in part basedon the press against the front side of the enclosure and the pressagainst the back side of the enclosure.

In Example 64, the subject matter of any one of Examples 49-63 canoptionally include the processing means dividing a capacitive touchsensor array on the back side of the enclosure into a plurality ofsections, in response to a determination that a number of inputs is lessthan three.

In Example 65, the subject matter of any one of Examples 1-16, canoptionally include a fourth display on at least one of the top side, thebottom side, the left side, the right side, and the back side of thedevice, the touch interaction information including a first touch on thefront side and a second touch on at least one side of the top side, thebottom side, the left side, the right side, and the back side, the logicbeing further configured to manipulate a three-dimensional object atleast in part based on the first touch and the second touch, and thefirst display and the fourth display displaying different views of thethree-dimensional object.

In Example 66, the subject matter of any one of Examples 3-16 and 65 canoptionally include the logic being further configured to ignore aportion of the touch interaction information at least in part based ongrip detection locations corresponding to the grip of the enclosure.

In Example 67, the subject matter of any one of Examples 17-32 canoptionally include manipulating a three-dimensional object at least inpart based on a first touch on the front side of the enclosure and asecond touch on at least one side of the top side, the bottom side, theleft side, the right side, and the back side of the enclosure; anddisplaying different views of the three-dimensional object on thedisplay and a third display on at least one of the top side, the bottomside, the left side, the right side, and the back side of the enclosure.

In Example 68, the subject matter of any one of Examples 19-32 and 67can optionally include ignoring a portion of the touch interactioninformation at least in part based on grip detection locationscorresponding to the grip of the enclosure.

In Example 69, the subject matter of any one of Examples 33-48 canoptionally include the method further comprising: manipulating athree-dimensional object at least in part based on a first touch on thefront side of the enclosure and a second touch on at least one side ofthe top side, the bottom side, the left side, the right side, and theback side of the enclosure; and displaying different views of thethree-dimensional object on displays on at least two of the top side,the bottom side, the left side, the right side, the front side, and theback side of the enclosure.

In Example 70, the subject matter of any one of Examples 35-48 and 69can optionally include the method further comprising: ignoring a portionof the touch interaction information at least in part based on gripdetection locations corresponding to the grip of the enclosure.

In Example 71, the subject matter of any one of Examples 49-65 canoptionally include a fourth displaying means on at least one of the topside, the bottom side, the left side, the right side, and the back sideof the device, the touch interaction information including a first touchon the front side and a second touch on at least one side of the topside, the bottom side, the left side, the right side, and the back sideof the device, the processing means manipulating a three-dimensionalobject at least in part based on the first touch and the second touch,and the first displaying means and the fourth displaying meansdisplaying different views of the three-dimensional object.

In Example 72, the subject matter of any one of Examples 49-65 and 71can optionally include the processing means ignoring a portion of thetouch interaction information at least in part based on grip detectionlocations corresponding to the grip of the enclosure.

Example 73 is a device, comprising: logic, at least partiallyimplemented in hardware, to receive touch interaction information from aplurality of touch sensor arrays disposed at least on two of a top side,a bottom side, a left side, a right side, a front side, and a back sideof the device, and to initiate an action based at least in part on thetouch interaction information.

In Example 74, the subject matter of Example 73 can optionally includethe touch interaction information being received from a first touchsensor array of the plurality of touch sensor arrays on the front sideof the device and from a second touch sensor array of the plurality oftouch sensor arrays on the back side of the device.

In Example 75, the subject matter of any one of Examples 73-74 canoptionally include the logic being to identify a user by detecting agrip of the device.

In Example 76, the subject matter of any one of Examples 73-75 canoptionally include the logic being to ignore a portion of the touchinteraction information in response to a determination that the portionis a result of hand jitter.

In Example 77, the subject matter of any one of Examples 73-76, canoptionally include the logic being to identify a user using a usagemodel learned based at least in part on the touch interactioninformation.

In Example 78, the subject matter of any one of Examples 73-77 canoptionally include the logic being to implement a backside pointer inresponse to a determination that a finger is within a predetermineddistance from the back side of the device.

In Example 79, the subject matter of any one of Examples 73-78 canoptionally include the logic being to receive the touch interactioninformation from a functional button displayed on the device in two ormore different locations of the device.

In Example 80, the subject matter of any one of Examples 73-79 canoptionally include the touch interaction information including a swipein one direction on the front side of the device and a swipe in theopposite direction on the back side of the device, and the logic beingto rotate a three-dimensional object based at least in part on the swipein the one direction and the swipe in the opposite direction.

In Example 81, the subject matter of any one of Examples 73-80 canoptionally include the touch interaction information including a hold onthe back side of the device and a swipe on the front side of the device,and the logic being to manipulate an image based at least in part on thehold and the swipe.

In Example 82, the subject matter of any one of Examples 73-81 canoptionally include the touch interaction information including a swipeacross the back side of the device, and the logic being to roll athree-dimensional object on a display based at least in part on theswipe.

In Example 83, the subject matter of any one of Examples 73-82 canoptionally include the logic being to initiate a same action based atleast in part on a swipe received on the back side of the device as anaction initiated based at least in part on a swipe received on the frontside of the device.

In Example 84, the subject matter of any one of Examples 73-83 canoptionally include the logic being to display an image on a display onat least one of the top side, the bottom side, the left side, and theright side of the device.

In Example 85, the subject matter of any one of Examples 73-84 canoptionally include the logic being to cancel touch interactioninformation received from a touch on the front side of the device inresponse to a determination that the touch is adjacent to a touch on theleft side or the right side of the device.

In Example 86, the subject matter of any one of Examples 73-85 canoptionally include the logic being to display an emulated hardwarebutton along a side of a display on the front side of the device.

In Example 87, the subject matter of any one of Examples 73-86 canoptionally include the touch interaction information including a pressagainst the front side of the device and a press against the back sideof the device, and the logic being to deform a three-dimensional objecton a display on the front side of the device based at least in part onthe press against the front side of the device and the press against theback side of the device.

In Example 88, the subject matter of any one of Examples 73-87 canoptionally include the logic being to divide a capacitive touch sensorarray on the back side of the device into a plurality of sections, inresponse to a determination that a number of inputs is less than three.

In Example 89, the subject matter of any one of Examples 73-88 canoptionally include the logic being to manipulate a three-dimensionalobject based at least in part on a first touch on the front side of thedevice and a second touch on at least one side of the top side, thebottom side, the left side, the right side, and the back side of thedevice, and to display different views of the three-dimensional objecton displays on at least two of the top side, the bottom side, the leftside, the right side, the front side, and the back side of the device.

In Example 90, the subject matter of any one of Examples 75-89 canoptionally include the logic being to ignore a portion of the touchinteraction information at least in part based on grip detectionlocations corresponding to the grip of the device.

We claim:
 1. A device to receive user inputs, the device comprising: anenclosure including a first capacitive touch sensor array disposed on afront face of the device, and a display disposed on the front face ofthe device; and logic configured to receive touch interactioninformation defined by a combination gesture including a first gestureon the front face of the device and a second gesture on a back face ofthe device, the back face of the device including at least onecapacitive touch sensor array; manipulate an image, based at least inpart on the combination gesture; and suppress a front touch on the frontface of the device, based at least in part on a determination that thefront touch is within a distance from a top face of the device, a bottomface of the device, a left face of the device, or a right face of thedevice.
 2. The device of claim 1, wherein the first capacitive touchsensor array is configured to receive the first gesture.
 3. The deviceof claim 1, further comprising: a second capacitive touch sensor arraydisposed on the top face, the bottom face, the left face, or the rightface, of the device, wherein the logic further is configured to receivetouch interaction information from the second capacitive touch sensorarray, and to initiate an action, based at least in part on the touchinteraction information from the second capacitive touch sensor array.4. The device of claim 1, wherein the distance is defined by an averagefingertip size.
 5. The device of claim 1, wherein the distance isbetween 8-10 mm.
 6. The device of claim 1, wherein the logic further isconfigured to display a plurality of buttons in a vertical column on aright side of the display, based at least in part on a determinationthat a right hand is holding the device.
 7. The device of claim 1,wherein the at least one capacitive touch sensor array is configured toreceive the second gesture.
 8. The device of claim 7, wherein the touchinteraction information indicates a swipe across the back face of thedevice.
 9. The device of claim 1, further comprising: a further displaydisposed on a face selected from the group consisting of the top face,the bottom face, the left face, or the right face, wherein the furtherdisplay displays volume controls or play controls.
 10. The device ofclaim 1, wherein the first gesture is defined by a swipe on the frontface of the device, the second gesture is defined by a hold on the backface of the device, and the logic further is configured to manipulatethe image by zooming in on the image, based at least in part on thecombination gesture.
 11. The device of claim 1, wherein visual feedbackfor a grip suppression area is displayed.
 12. The device of claim 1,wherein the first gesture is defined by a first press on the front faceof the device, the second gesture is defined by a second press on theback face of the device, and the logic further is configured tomanipulate the image by deforming the image, which is of athree-dimensional object, on two opposite surfaces, based at least inpart on the combination gesture.
 13. A non-transitory, computer-readablemedium that stores instructions that, when executed by a device, causethe device to perform operations to receive user inputs, the deviceincluding a capacitive touch sensor array and a display disposed on afront face of the device, the operations comprising: receiving touchinteraction information defined by a combination gesture including afirst gesture on the front face of the device and a second gesture on aback face of the device, the back face of the device including at leastone capacitive touch sensor array; manipulating an image, based at leastin part on the combination gesture; performing a determination that afront touch on the front face of the device is within a distance from atop face of the device, a bottom face of the device, a left face of thedevice, or a right face of the device; and suppressing the front touchon the front face of the device, based at least in part on thedetermination.
 14. The medium of claim 13, wherein the distance isdefined by an average fingertip size or is between 8-10 mm.
 15. A methodimplemented by an apparatus to receive user inputs, the methodcomprising: receiving a front touch on a front face of a device, thefront face of the device including a capacitive touch sensor array and adisplay; receiving touch interaction information defined by acombination gesture including a first gesture on the front face of thedevice and a second gesture on a back face of the device, the back faceof the device including at least one capacitive touch sensor array;manipulating an image, based at least in part on the combinationgesture; performing a determination that the front touch is within adistance from a top face of the device, a bottom face of the device, aleft face of the device, or a right face of the device; and suppressingthe front touch on the front face of the device, based at least in parton the determination.
 16. The method of claim 15, wherein the distanceis defined by an average fingertip size or is between 8-10 mm.